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ABSTRACT 

The National Polar-orbiting Operational Environmental Satellite System (NPOESS) Airborne Sounder Testbed- 
Interferometer (NAST-I) instrument is a high-resolution scanning interferometer that measures emitted thermal radiation 
between 3.3 and 18 microns. The NAST-I radiometric calibration is achieved using internal blackbody calibration 
references at ambient and hot temperatures. In this paper, we introduce a refined calibration technique that utilizes a 
principal component (PC) noise filter to compensate for instrument distortions and artifacts, therefore, further improve 
the absolute radiometric calibration accuracy. To test the procedure and estimate the PC filter noise performance, we 
form dependent and independent test samples using odd and even sets of blackbody spectra. To determine the optimal 
number of eigenvectors, the PC filter algorithm is applied to both dependent and independent blackbody spectra with a 
varying number of eigenvectors. The optimal number of PCs is selected so that the total root-mean- square (RMS) error 
is minimized. To estimate the filter noise performance, we examine four different scenarios: apply PC filtering to both 
dependent and independent datasets, apply PC filtering to dependent calibration data only, apply PC filtering to 
independent data only, and no PC filters. The independent blackbody radiances are predicted for each case and 
comparisons are made. The results show significant reduction in noise in the final calibrated radiances with the 
implementation of the PC filtering algorithm. 
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1. INTRODUCTION 

The National Polar-orbiting Operational Environmental Satellite System (NPOESS) Airborne Sounder Testbed- 
Interferometer (NAST-I) instrument is a high-resolution scanning interferometer that measures emitted thermal radiation 
between 3.3 and 18 microns. The raw interferogram measurements are radiometrically and spectrally calibrated to 
produce radiance spectra, which are further processed to obtain temperature and water vapor profiles of the Earth's 
atmosphere via retrieval algorithms. NAST-I produces sounding data with 2 kilometer resolution (at nadir) across a 40 
kilometer ground swath from a nominal altitude of 20 kilometers onboard a NASA ER-2 aircraft or similar coverage 
from the PROTEUS aircraft. 

The NAST-I radiometric calibration is achieved using internal blackbody calibration references at ambient and hot 
temperatures. In this paper, we introduce a refined calibration technique that utilizes a principal component (PC) noise 
filter to compensate for instrument distortions and artifacts, therefore, further improve the absolute radiometric 
calibration accuracy. 1,2 The calibration procedure is summarized in the following steps: the raw interferograms are 
partitioned into 30-minute segments for calibration purposes; a PC noise filtering algorithm is applied to hot blackbody 
(HBB) and ambient blackbody (ABB) calibration reference spectra; using the filtered HBB and ABB data, the 
responsivity and offset coefficients are computed and applied to PC-filtered Earth scene spectra, which results in 
calibrated scene radiances. 

To test the procedure and estimate the PC filter noise performance, we form dependent and independent test samples 
by using odd and even sets of blackbody spectra. To determine the optimal number of eigenvectors, the PC filter 
algorithm is applied to both dependent and independent blackbody spectra with a varying number of eigenvectors. The 
responsivity and offset coefficients are computed from filtered dependent spectra, and then applied to the filtered 
independent spectra, from which, we can predict the independent blackbody radiances. The total root-mean-square 
(RMS) error as a function of eigenvectors is evaluated by comparing the predicted blackbody radiances with ideal 
Planck radiances. The optimal number of PCs is selected so that the total RMS value is minimized. To see the filtering 
effect on the calibration noise performance, we examine four different scenarios: apply PC filtering to both dependent 
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and independent datasets, apply PC filtering to dependent calibration data only, apply PC filtering to independent data 
only, and no PC filters. The independent scene radiances are predicted for each case and comparisons are made. The 
results show significant reduction in noise in the final calibrated radiances with the implementation of the PC filtering 
algorithm. 


2. PRINCIPAL COMPONENT NOISE FILTERING 

In this section, we describe the PC filtering algorithm that will be employed to reduce noise for any given group of 
spectra. First we define NAST-I data in matrix forms, and then introduce the fundamental filtering technique. 

2.1 Data Definition 

Each NAST-I data measurement set contains thirteen atmospheric scene measurements, one ABB calibration reference, 
and one HBB calibration reference. Given 
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spectral channel indices, i = 1, I represents the set number, j = denotes the scene index, and 
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respectively. 

To apply the PC noise filter, we combine 120 sets (a 30-minute segment) of spectra to form supersets. Define 

q — 1, 2, |_T^)J as the superset index and s — 1, . . . , S as the new measurement scan number. The notation for the 

new scene spectra can be written as 
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similarly, we define the new ABB forward scans, ABB reverse scans, HBB forward scans, and HBB reverse scans as 


respectively. 
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2.2 PC Noise Filter Algorithm 


Once we have established the NAST-I data representation, the PC filtering method can be outlined as the following. 
Suppose represents the spectra for any given superset f3 for a particular scene cr with A = A scans, its 

equivalent matrix form can be written as 
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Using singular value decomposition (SVD), N can be factorized into 


N = UDP ,t , (7) 

where *T denotes conjugate transpose; D — diag{di, . . . , d / } in which d\ > . . . > dz > 0 and Z — min{A, A'}. 
From which, the projection of the original dataset is expressed as 

S = D* r N. (8) 

The PC filtered spectra can be derived using 

N = P e *S H- n, (9) 

where e* is the optimal number of eigenvectors employed by the PC filter. To simplify the notation, we can write the PC 
filtering operation described above as N e * — pcf e * {N}, where pcf^* {■} denotes the NAST-I PC-filter operator. 

3. PC FILTER NOISE PERFORMANCE ESTIMATION 

Previously we have introduced the underlining PC filtering method. In this section, we discuss the procedure for testing 
and estimating the filter performance, which is outlined in Figure 1. First, the dependent and independent test samples 
are formed using odd and even sets of blackbody spectra, then we examine four different scenarios: apply PC filtering to 
both dependent and independent datasets, apply PC filtering to dependent calibration data only, apply PC filtering to 
independent data only, and no PC filters. The independent blackbody radiances are predicted for each case and 
comparisons are made using the theoretical Plank radiances as references. 



Figure 1. PC filtering noise estimation procedure. 


3.1 Dependent and Independent Test Datasets 

The dependent and independent test samples are formed using odd and even sets of blackbody spectra. We define the 
ABB forward dependent and independent spectral matrices within any given superset /? as 
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where the new scan index is t = 1 , 2, . * . , T; T = 4, the new set index is l = 1, 2, . * * , 60, and the odd and even sets are 
written as 0{*} and £{*}. Similarly, we define the ABB reverse dependent and independent matrices as N Ard and N Ari 
respectively. By applying the same notation to HBB test matrices, we obtain N /7 ^, N H *i, N 7frd , and N Hri . Next, we 
compute the 2-point moving average of the dependent sets so that they can be used as close approximations in time of 
the independent test sets. The moving average operation performed on ABB forward dependent dataset can be written as 
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where P = 2. Similarly, we obtain N‘' rd , and N 




3.2 Determination of the Optimal Number of Eigenvectors 

Next, we need to determine the optimal number of eigenvectors needed to filter the test datasets. Using the PC algorithm 
described in the previous section, we apply PC filter operation to dependent and independent blackbody spectra with a 

varying number of eigenvectors, e, for instance, N e ** = pc f e { N*' /d } and = pc/ e {N^A}. Similarly, we apply 
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the PC algorithm to the remaining blackbody spectra matrices to obtain N e , N r , N e , N e , and N t; rj: . 

Next, we compute the forward responsivity and offset coefficients using the filtered dependent spectra 
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respectively, where B n f A f denotes the ideal Planck radiances at hot and ambient temperatures. We can then predict the 
forward independent radiances to be 
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and 
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in which SR{ * } denotes the real part of the complex radiance. Repeat the same process to obtain the reverse responsivity, 

offset, and predicted independent radiances as R£ d , O^, L t , and L t .To compute the total minimum mean square 
error, we can merge the forward and reverse radiances at ambient and hot temperatures into a single matrix, for example, 

- ~A r ~Hf 

L c = {L e , L e , L e , L e }, where e is the full rank of the radiance matrix. Define the Planck matrix as 
B — {B Af , B^j B ;/ U B //f }. The difference between predicted independent radiances and ideal blackbody spectra is 

E t . = L e — B. Define the RMS error spectrum as 
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where E f ,(k) — yYIJ-) is the sample mean. The optimal number of eigenvectors, e*, is determined so that the 

RMS error is minimized across the entire spectral band. For instance 
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3.3 Noise Performance Estimation 


e 


EM*) • 


k=l 


To see the filtering effect on the calibration noise performance, we examine four different scenarios. In the first case, the 
filtered dependent data are applied to filtered independent data. This is the same scenario described in the previous 
section where we derived the optimal number of eigenvectors e * using the iterative method. The predicted independent 

radiances can be written as L t >#, its corresponding RMS error is expressed as (&). 

In the second case, to see the filtering effect on the independent data, we can apply the PC filter algorithm to only the 
independent spectra while keeping the dependent data unfiltered. We compute the unfiltered forward responsivity and 
offset coefficients from 
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The forward independent radiances are predicted from filtered independent spectra using unfiltered responsivity and 
offset. The results are written as 


and 



N^l 

R/' 


R/' 



( 21 ) 

( 22 ) 


~ ~A f ~A r ~Hf ~H r ~ ~ 

The combined radiance matrix is L e » — ,L e . , L e . , L e . } and — B. We can derive its corresponding 

RMS error to be e e » (k). Figure 2 illustrates the RMS noises in brightness temperature for cases 1 and 2. 
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Figure 2. A comparison of RMS noises in BB brightness temperature for cases 1 & 2 (scan average). 


In the third case, the filtered dependent data are applied to unfiltered independent data to illustrate the filtering effect 
on the dependent data. Similar to previous calculations, we compute the filtered forward responsivity and offset 
matrices from 


and 





B H f - B v / 


5 /, = N e . *B"/-N e . * B 


A, 


N. 


•J*t d 


n' 1 /" 


(23) 


(24) 


The forward independent radiances are predicted from unfiltered independent spectra using filtered responsivity and 
offset. The results are written as 
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The combined radiance matrix is ,L t> * , L e . } and E e * = L c * — B. We can derive its corresponding 

RMS error to be (k). 

In the last case, the calibration was performed without PC filters. Here we compute the unfiltered radiances to be 
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The combined radiance matrix is L — {h A f, I/ 7 "} and E = L — B. Its corresponding RMS error is e(k). 

Figure 3 illustrates the RMS noises in brightness temperature for cases 3 and 4. 
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Figure 3. A comparison of RMS noises in BB brightness temperature for cases 3 & 4 (scan average). 


4. COMPLEX PC RADIOMETRIC CALIBRATION 


In the previous section, we have presented the procedure for testing and estimating the filter performance using 
blackbody spectra as dependent and independent test simples. In this section, we apply the PC filtering method to actual 
Earth scene spectra. Figure 4 describes the complex PC radiometric calibration process. Initially, the spectra are 
partitioned into 30-minute segments according to their scan directions, and then we apply the filtering algorithm to both 
the blackbody calibration data and Earth scene data using the optimal number of eigenvectors. The responsivity and 
offset coefficients are computed and the calibrated radiances are obtained. The same process is repeated for all data 
segments. The calibrated radiances for all segments are then regrouped into their original format. 



Figure 4. Complex PC radiometric calibration procedure. 


4.1 Optimal Eigenvectors for Atmospheric Scene Spectra 

Before we can implement the PC filter to the atmospheric scene spectra, the optimal number of eigenvectors must be 
determined. Define the ABB and HBB forward and reverse matrices as = Na/s' A *' IIj ' n "(k), the forward 

and reverse scenes as N ( f ' Cr = A r c ^j'^ r (fc), and the PC filtered blackbody calibration matrices as 

= P c Je* ” 1 /. We derive the radiances for two cases. In the first case, we apply PC filtering 

to the calibration data but leaving the Earth scene data unfiltered. In this case, the filtered forward responsivity and offset 
coefficients are 
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Apply these coefficients to unfiltered scene data to obtain the forward-scan calibrated radiances 
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The calibrated radiances for reversed scans are computed using the same procedure, and the total combined radiances are 
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written as L = {L , L } p or second case, we apply PC filtering to both the calibration and Earth scene data. In 
this case, the forward-scan radiances can be written as 
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where v is the number of eigenvectors used to filter the scene spectra; the optimal value v* is to be determined using an 
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iterative method. The combined radiance matrix for the forward and reverse scans is L t . - iK ,K }. Define the 
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To derive the optimal number of eigenvectors used by the scene filter, a reference term is generated using the results that 
were obtained previously. Recall in Section 3.3, the filtered dependent data were applied to filtered independent data in 
the first case and the filtered dependent data were applied to unfiltered independent data in the third case. Using the 
results from those two cases, define a new variable to represent the difference between them, for instance, 

Dg* = — L e *. Its RMS value is 
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which represents the minimum noise level experienced by the independent scene data. The optimal number of 
eigenvectors for the scene filter, u*, is the number that leaves a residual slightly smaller than this noise level. It can be 
determined from 

v * = min \d v (k) — d rc r (k ) I V k • (35) 

v J 

Figure 5 illustrates the iterative process for finding the optimal number of eigenvectors of the scene filter. Using the 
reference term d re f(k) (shown in black), the solution of Eqn. (35) is found so that the residual noise d v (k) (shown in 
magenta) is similar to the reference noise level. In Figure 6, the absolute summation of d v (k) — d re f(k) over the entire 
frequency band, |^(&) — d re j(k ) |, is computed at various PC numbers. The optimal PC number is shown as the 
minimum point on the curve. 
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Figure 5. An iterative method for finding the optimal number of eigenvectors used by the scene filter. 



Figure 6. The optimal number of eigenvectors used by the scene filter. 


4.2 Complex Radiometric Calibration Algorithm 

Using the PC number for the calibration filter e* and the PC number for the scene filter i;*, the PC filtered radiances can 
be obtained from 
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Finally, the combined radiance matrix for the forward and reverse scans is L tr — [L v » , L v . I 
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5. CONCLUSION 

In this paper, we introduce a refined calibration technique that utilizes a PC noise filter to compensate for instrument 
distortions and artifacts, therefore, further improve the absolute radiometric calibration accuracy. To test the procedure 
and estimate the PC filter noise performance, we form dependent and independent test samples by using odd and even 
sets of blackbody spectra. To see the filtering effect on the calibration noise performance and to find the optimal number 
of eigenvectors, we examine four different scenarios: apply PC filtering to both dependent and independent datasets, 
apply PC filtering to dependent calibration data only, apply PC filtering to independent data only, and no PC filters. The 
independent scene radiances are predicted for each case and comparisons are made. The results show significant 
reduction in noise in the final calibrated radiances with the implementation of the PC filtering algorithm. 
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